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INTEGRATED, PROPORTIONALLY CONTROLLED, AND NATURALLY 
COMPLIANT UNIVERSAL JOINT ACTUATOR WITH CONTROLLABLE 

STIFFNESS 

CROSS-REFERENCE TO RELATED APPLICATIONS 
[0001] This application is a continuation-in-part of United States Patent 
Application No. 10,318,452, filed on December 12, 2002, which is a continuation- 
in-part of United States Patent No. 6,512,345, which was filed on March 30, 
2001 . The disclosures of this application and patent are incorporated herein by 
reference. 

STATEMENT OF GOVERNMENTAL SUPPORT 
[0002] This invention was made with Government support under Award 
No. DE-FG04-86NE37969 awarded by the U. S. Department of Energy. The 
Government has certain rights in this invention. 

FIELD OF THE INVENTION 
[0003] The present invention generally relates to the actuation of joints 
in mechanical structures and, more particularly, to a pneumatically operated 
actuation system efficiently integrated in the space occupied by a joint, as well as 
the simultaneous proportional control of position and stiffness of that joint. 
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BACKGROUND OF THE INVENTION 
[0004] Robotic vehicles are often used to navigate or traverse varying 
terrain. As is well known, wheeled robotic vehicles, both large and small, are 
particularly well adapted for travel over relatively smooth terrain, such as roads 
and smooth floors. However, it is often necessary for robots to traverse terrain 
that is not smooth, such as stairs or curbs. Moreover, it is often necessary for 
robots to traverse terrain that may pose a danger to humans, such as those 
situations presenting an environmental risk, military risk, or the like. Often robotic 
devices are useless in these dangerous situations because of their inability to 
successfully and reliably traverse any severely broken and/or fractured ground 
that they may encounter. Attempts have been made to overcome the numerous 
disadvantages of wheeled robotic vehicles in these situations by simply 
increasing the diameter of the wheels or adding tank crawler tracks to increase 
the ability of the robotic device to traverse large objects or spans. However, 
these solutions include additional disadvantages, such as increasing the overall 
size of the vehicle, which may inhibit the robot's ability to pass through small 
openings. 

[0005] Furthermore, many robots suffer from being rendered immobile 
as a result of a rollover or other situation that prevents contact of their propulsion 
member(s) on the ground surface. That is, should a wheeled robot encounter a 
grade sufficient to roll it on its side, the wheels are no longer capable of 
propelling the robot. In terrains that pose a risk to humans, such rollovers may 
render the robot unrecoverable. 
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[0006] Recently, articulating robotic mechanisms, which are also 
sometimes referred to as snake or serpentine robots, have been developed that 
successfully overcome the disadvantages of the prior art and navigate such 
inhospitable environments. Such robots typically employ three or more rigid 
segments, which are connected through joints. The joints may permit one, two, 
or more Degrees-of-Freedom (DOF). Examples of commonly invented robotic 
mechanisms can be found in U.S. Patent No. 6,512,345 and U.S. Patent 
Application No. 10/318,452, the disclosures of which are incorporated herein by 
reference. However, often times prior art robotic devices fail to provide adequate 
range of motion and/or force necessary to articulate the various robotic segments 
in demanding environmental situations 

[0007] Accordingly, there exists a need in the relevant art to provide a 
joint actuator that is capable of providing improved range of motion and/or 
articulating force. Further, there exists a need in the relevant art to provide an 
apparatus for traversing obstacles that overcomes the disadvantages of the prior 
art. 

SUMMARY OF THE INVENTION 
[0008] According to the principles of the present invention, an 
apparatus for traversing obstacles having an advantageous design is provided. 
The apparatus includes an elongated, round, flexible body that further includes a 
plurality of segments interconnected by an integrated joint actuator assembly. 
The integrated joint actuator assembly includes a plurality of bellows-type 
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actuators individually coupling adjacent segments to permit pivotal actuation of 
the apparatus therebetween. A controller is employed to maintain proper 
positional control and stiffness control while minimize airflow. 

[0009] Further areas of applicability of the present invention will 
become apparent from the detailed description provided hereinafter. It should be 
understood that the detailed description and specific examples, while indicating 
the preferred embodiment of the invention, are intended for purposes of 
illustration only and are not intended to limit the scope of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0010] The present invention will become more fully understood from 
the detailed description and the accompanying drawings, wherein: 

[0011] FIG. 1 is a perspective view illustrating an apparatus for 
traversing obstacles according to a first embodiment of the present invention; 

[0012] FIG. 2 is a perspective view illustrating an apparatus for 
traversing obstacles according to a second embodiment of the present invention 

[0013] FIG. 3 is an enlarged perspective view illustrating the integrated 
joint actuator assembly of the present invention; 

[0014] FIG. 4 is a schematic side view illustrating the integrated joint 
actuator assembly; 

[0015] FIG. 5 is a cross-sectional view illustrating the bellows of the 
integrated joint actuator assembly; 
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[0016] FIG. 6 is an enlarged schematic side view illustrating the 
integrated joint actuator assembly; 

[0017] FIGS. 7(a) and (b) illustrate the spacing requirement between 
adjacent segments; 

[0018] FIG. 8 is an actuation stress versus actuation strain curve; 

[0019] FIGS. 9(a) and (b) is a schematic view illustrating the pneumatic 
circuit of the present invention; 

[0020] FIG. 10 is a block diagram illustrating the control system of the 
present invention; and 

[0021] FIGS. 11(a) and (b) are experimental result of a conventional 
control system (FIG. 11(a)) and the control system of the present invention (FIG. 
11(b)). 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 
[0022] The following description of the preferred embodiment is merely 
exemplary in nature and is in no way intended to limit the invention, its 
application, or uses. That is, it should be understood that although the present 
invention is discussed in connection with robotic devices, the present invention 
might find utility in a wide variety of applications. 

[0023] Briefly, by way of background, there are a number of desirable 
design criteria that ideally would be met in a commercially viable serpentine 
robot. Serpentine robots are typically relatively long compared to their diameter, 
so that their lead segments can reach up and over a high step while still being 
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able to fit through small openings. Because of this geometric constraint, as well 
as other unique characteristics of serpentine robots, the following requirements 
can be derived (in decreasing order of importance). 

[0024] It is primarily desirable that a serpentine robot be able to 
compliantly conform to terrain, such that the maximum number of driving 
segments are in contact with the ground at any times to provide reliable 
propulsion. Serpentine robots that do not conform compliantly often require 
complex sensor systems that measure contact forces and command a 
momentary angle for each non-compliant joint so as to force contact with the 
ground. Such actively controlled compliance has not yet been successfully 
demonstrated, and may well be unfeasible for many years. 

[0025] Additionally, it is often desirable that the stiffness of a joint may 
be selectively increased for specific applications, such as crossing a gap or 
reaching over an obstacle. While other times, it is necessary to adjust carefully 
the stiffness to an intermediate level, such as when the lead segment leans 
against a vertical wall while being pushed up that wall by the following segments. 
Serpentine robots must thus be capable of adjusting the stiffness of every degree 
of freedom individually and proportionally. 

[0026] Still further, it is desirable in serpentine robot applications that 
the joint angles be controllable proportionally to allow "steering" of the front 
segment with "follow-the-leader" control of all following segments. Additionally, 
certain motion sequences, such as climbing over a step, require gradual or 
proportional control of all joint angles. 
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[0027] It is also desirable that any actuators disposed between 
adjacent segments of the serpentine robot (hereinafter "joint actuators") be 
capable of developing sufficient force to lift at least two lead segments to the 
edge of a step in order to climb over it. This requirement is particularly difficult to 
meet in small-diameter serpentine robots because of the short moment arm 
available to an actuator applying a force in longitudinal direction. 

[0028] A further desired feature is that joint actuators take up as little 
space as possible, because space in a small-diameter serpentine robot is 
extremely limited. 

[0029] Finally, it is desirable that energy consumption and weight of the 
joint actuators be minimized, because energy is a limited resource in an 
untethered mobile robot. Weight minimization is a related requirement because it 
translates directly into a reduction in energy consumption. 

[0030] Prior implementations of serpentine robots did not meet all of 
these requirements, mainly because no joint actuator existed that would meet 
these requirements. For that reason, many serpentine robots exist only in the 
form of research subjects but not as commercially viable products. 

[0031] There are many different ways of actuating joints in a 
mechanical structure. However, only a few of them can provide the range of 
motion and force required to actuate the joints of a serpentine robot. Those 
actuators include electrical motors, hydraulic motors or actuators, and pneumatic 
actuators. Of these, only pneumatic actuators are naturally compliant. The 
present invention recognizes this fact and employs pneumatic actuators. This 
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realization, however, is far from trivial in that no other known serpentine robot 
employs pneumatic actuators. 

[0032] Referring now to FIGS. 1 and 2, an integrated joint actuator 
assembly 100 is illustrated in connection with a first embodiment (FIG. 1), 
generally indicated at 10, having an elongated, flexible body and a coordinated 
millipede-type propulsion and a second embodiment (FIG. 2), generally indicated 
at 10', having an elongated, flexible body, and a drive track propulsion system. 
The present invention is primarily related to the construction and operation of 
integrated joint actuator assembly 1 00 with apparatus 1 0 and apparatus 1 0' or 
the like. It should be appreciated that apparatus 10 and apparatus 10' are similar 
in construction to those described in detail in U.S. Patent No. 6,512,345 and U.S. 
Patent Application No. 10/318,452, which were incorporated herein. In the 
interest of brevity, only those areas in the present invention that differ will be 
discussed in detail herein. 

[0033] Referring now to FIGS. 1-3, apparatus 10 and apparatus 10' are 
provided for traversing obstacles. Each of these apparatuses includes a plurality 
of identical segments 12, 12'. Each of the plurality of segments 12, 12' includes 
a plurality of articulating leg mechanisms 14 (FIG. 1) or a plurality of drive track 
assemblies 14' disposed about the periphery of each segment 12, 12'. The 
plurality of articulating leg mechanisms 14 and the plurality of drive track 
assemblies 14' are adapted to propel apparatus 10 and apparatus 10', 
respectively. Adjacent segments 12, 12' are joined together via integrated joint 
actuator assembly 100 and a drive shaft 16. Preferably, drive shaft 16 is a two- 
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degree of freedom universal joint. However, it should be appreciated that drive 
shaft joints having higher or lower degrees-of-freedom may be used. 

[0034] As best seen in FIGS. 3-6, integrated joint actuator assembly 
100 generally includes preferably four inflatable, pressure-resistant, flexible, 
hollow bodies, similar in function to pneumatic bellows and hereafter referred to 
as bellows 102. Each closed end of bellows 102 is coupled between adjacent 
segments 12, 12' along walls 104 via a fastener 106. Fluid communication is 
established with each bellows 102 to permit selective inflation and deflation of 
bellows 102 for proper control of integrated joint actuator assembly 100, which 
will be discussed below. It is preferred that bellows 102 are arranged in a 
general square-shaped orientation when viewed in cross-section (FIG. 5). 
However, it should be appreciated that any number of bellows may be used that 
provide adequate articulation control. 

[0035] It is believed that a description of the operation of integrated 
joint actuator assembly 1 00 will facilitate an understanding of its construction and 
method of use. With particular reference to FIGS. 4 and 6, apparatus 10' is 
illustrated employing integrated joint actuator assembly 1 00. This arrangement is 
often useful for scaling or otherwise traversing a vertical obstacle 22. To this 
end, the lifting of the first two segments 12' (hereinafter referred to as 12'a and 
12'b) relative to the remaining segments 12' (hereinafter referred collectively as 
12'c) is often necessary. Segment 12'a and segment 12'b are interconnected via 
integrated joint actuator assembly 100a, which includes bellows 102a,b and 
bellows 102c,d. Likewise, segment 12'b and segment 12'c are interconnected 
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via integrated joint actuator assembly 100b, which includes bellows 102e,f and 
bellows 102g,h. Segment 12'a has a weight generally indicated as Wa and 
segment 12'b has a weight generally indicated as Wb. In order to accomplish 
this task, integrated joint actuator assembly 100b inflated bellows 102g,h and 
exhausts bellows 102e,f. This creates a lifting moment M that must be sufficient 
to overcome the total reactive moment from the weight of each two segment 12'a 
and 12'b (M rea c t = LiW b +L 2 W a ). 

[0036] It should be understood that the apparatus of the present 
invention does not have a defined "up" or "down"; therefore it is intended to 
operate similarly from any orientation. Additionally, it may be rotated on one of 
its edges (as can be illustrated by rotating FIG. 5 45° or 135°). In such a case, 
only one single bellows would be necessary to contribute to the lifting moment M. 
In this case, the lever arm for producing this lifting moment would have length L, 
as shown in FIG. 5. The lifting moment produced by one bellows can be 
computed as: 

M = LAP = L(Vfed) 2 TrP (1) 

where A is the cross sectional area of the bellows , P is the air pressure inside 
the bellows , and d is the diameter of the bellows . 

[0037] It should be appreciated that for most serpentine robots, which 
are typically slender, the two geometric factors d and L are very limited. 
Therefore, as Eq. (1) suggests, the bellows' diameter d and the bellows' distance 
from the center L should be as large as possible to produce the largest lifting 
moment M needed to lift the two front segments 12'a and 12'b. Furthermore, 
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since the lifting moment M is proportional to d 2 , it is imperative that the diameter 
of the bellows be as large as possible. 

[0038] In order to select a desired bellows, a number of pneumatic 
actuators have been considered, specifically cylinders, bellows, and so-called 
McKibben pneumatic muscles. It is known that cylinders and bellows develop 
force in quadratic proportion to their diameter d. However, pneumatic muscles 
develop force in relation to their diameter and length. Therefore, pneumatic 
muscles can produce an actuation force that is much larger than the force 
generated by a cylinder with the same diameter. However, a larger force 
requires greater length of the pneumatic muscle and the output force drops 
quickly as the pneumatic muscle contracts. The actuation force of bellows also 
drops with expansion, but not nearly as dramatically as that of McKibben 
pneumatic muscles. 

[0039] As a result their inherent geometric characteristics, cylinders 
and McKibben pneumatic muscles would have to be placed within segments 12, 
12' to actuate the joint therebetween. Accordingly, it is believed that the use of 
cylinders or McKibben pneumatic muscles would require excessive space within 
each segment 12, 12', thereby dramatically limiting the space available for the 
mechanical drive components, pneumatic valves, electronic components, and the 
like. 

[0040] In contrast to cylinders and McKibben pneumatic muscles, the 
present invention provides an ideal solution to these space constraints as it 
employs a plurality of large-diameter pneumatic actuators, bellows 102, generally 
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contained within the space between segments 102, thereby maximizing the 
space available of other components. 

[0041] With particular reference to FIG. 7, it can be seen that in a 
flexed orientation (see FIG. 7(b)) there is very little room within the space 
between adjacent segments 12, 12' (hereinafter referred to as joint space 108). 
Additionally, as can be seen in FIGS. 7(a) and 7(b), this joint space 108 varies 
between a maximum space 108a and a minimum space 108b in response to joint 
angle. Because of these variations, the largest rigid component that can be 
mounted in joint space 108 has to be limited in size to fit into minimum space 
108b. In practice, this means that a rigid actuator most likely cannot be used 
within joint space 108 due to the space requirements. In contrast to rigid 
components, bellows have the highly suitable property of taking up minimum 
space when deflated and maximum space when inflated. Therefore, the bellows 
may be placed in joint space 108 without taking up any space within segments 
12, 12'. 

[0042] The location of bellows 102 in joint space 108 permits larger 
actuator diameters than what would be possible if the actuators had to be placed 
within a segment. As will be recalled, because the maximal actuation force is 
proportional to the square of the actuator diameter (d 2 ) in bellows and cylinders, 
bellows-type actuators can produce a larger actuation force than cylinders. This 
comparison cannot be made with pneumatic muscles since the actuation force of 
pneumatic muscles is also dependent upon its length. However, as will be 
discussed, the stroke of pneumatic muscles is very limited. 
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[0043] In most cylinder-type actuators, actuation strain is limited to less 
than 1.0, because the piston and rod cannot move through a greater distance 
than one cylinder length. In pneumatic muscles, the actuation strain is about 0.3, 
and in pneumatic bellows, the actuation strain can reach 4.0. As is apparent 
from FIG. 8, bellows-type actuators have a slight advantage over cylinders and 
pneumatic muscles in terms of their actuation stress vs. actuation strain. This, 
together with the earlier discussed advantage of the placement of the bellows in 
joint space 108 allows for larger diameters and thus larger force, demonstrates 
that the present invention provides the best solution for force generation. 

[0044] Although it is clear that pneumatic actuation, and especially 
bellows-type actuation is desirable over other methods, pneumatic systems 
require a source of compressed air, multiple valves, and control methods for 
those valves. The supply of compressed air is of particular concern for mobile 
robots - unless, of course, they are tethered. Truly autonomous, untethered 
robots have to produce their own compressed air from very limited on-board 
resources, thus increasing weight, requiring space, and consuming power. 

[0045] Traditionally pneumatic systems are designed for so-called pick- 
and-place operations. In these applications, the actuator moves from one end of 
its stroke to the other. Compressed air consumption is limited to the amount of 
air used for performing the stroke. Once the actuator reaches its desired end- 
point, no additional air is being consumed. Such pick-and-place operation is too 
limited for the actuation of joints in serpentine robots. 
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[0046] More advanced methods, which allow the proportional control of 
pneumatic actuators, were introduced in recent years. Common to these 
proportional control methods is their continuing consumption of compressed air, 
both during motion and while remaining stationary. This is not a particular 
concern in conventional (i.e., industrial) pneumatic systems where there is 
usually a local source of compressed air that can provide an unlimited supply of 
compressed air at little cost. However, for mobile robots requiring pneumatic 
actuation, these proportional control methods are not suitable. 

[0047] Another conventional method of implementing proportional 
control pneumatic is based on the use of servo valves. While pneumatic servo 
valves can be very precise, they also tend to be heavy and bulky. They are thus 
more suitable for stationary manipulators than for mobile robots. For smaller 
mobile robots, much lighter and compact on-off valves are a more applicable 
solution. Earlier solutions using on-off valves for implementing proportional 
control worked in a way that is similar to pulse width modulation (PWM) in 
electrical motors. That is, the valve rapidly moves between supplying and 
exhausting fluid. While rather good control is achieved this way, compressed air 
is continuously wasted even if the actuator is only holding but not moving. 

[0048] A reduction in air consumption may be achieved using a four- 
valve configuration, as shown in FIGS. 9(a) and 9(b), which closes the chambers 
of cylinder-type actuators in steady state and thereby preserves compressed air. 
However, in this configuration the stiffness of the joints was not controlled. In 
serpentine robots and certain other applications, stiffness must be controlled at 
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all times. For example, when multiple segments of a serpentine robot span a 
gap, very high stiffness must be maintained, whereas when traveling across 
rugged terrain, minimal stiffness (i.e. maximum compliance) must be maintained. 

[0049] In order to provide proportional position control and proportional 
stiffness control, as well as zero-airflow at steady state, a novel proportional 
control system is provided as illustrated in FIG. 10, generally referred to as 
proportional position and stiffness controller 110. Proportional position and 
stiffness controller 1 10 can be represented by the following relationships: 

block INV contains: 

S = Pl + p 2 (2) 

where: 
/-inertia, 

q- joint's position, 

Tp=LA(prP2)- pneumatic torque, L - force arm as shown in Figure 5, 
Pi, 92- pressures in opposite bellows, 
ts- spring-like torque, 
t- load torque, 

A - bellows cross section area, 
S - reference stiffness of the joint, 



and block K(p s ,p,q) contains: 

G = RkTm = pV + kpV + K P Ve p + K D Ve p 
D = G f p if G>0 

A s^Ps - P 

D = G— — ^ if G<0 



(3) 
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where Dp represents the period of the pulse width modulation controller and D 
represents the length of a pulse in the pulse width modulated controller. Four 
different signals D1..D4 control appropriate valves according to FIG 9. D is 
always a fraction of Dp. Additionally, ep represents the pressure error and K 
represents the proportional coefficient. The coefficients As = 68 and Ae =-72 
were estimated using experimental data and a least square fit. 

[0050] With particular reference to FIGS. 1 1 (a) and 1 1 (b), experimental 
results are illustrated in which a pair of pneumatic bellows is controlled using a 
conventional proportional pneumatic control system (FIG. 11(a)) and proportional 
position and stiffness controller 110 (FIG. 11(b)) to move a joint in a sinusoidal 
fashion, for two full periods. As can be seen in FIG. 11(a), the absence of 
stiffness control in the conventional proportional pneumatic control system 
causes the stiffness of the bellows to vary arbitrarily as a function of position. 
FIG. 11(b) illustrates how proportional position and stiffness controller 110 
maintains a near-constant stiffness of 20% (as was commanded in this example). 
According to the present invention, stiffness may also be varied if desired 
throughout a full range of 0%-100% under computer control. 

[0051] As can be seen from the lower air flowrate curve of FIGS. 1 1(a) 
and 1 1 (b), the air consumption of the present invention is lower than that of the 
conventional proportional pneumatic control system as is shown by the 
concentration of flowrate data at a lower position on the flowrate graphs. In this 
particular example, proportional position and stiffness controller 110 of the 
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present invention reduced airflow by a factor of two over the conventional 
proportional controller. 

[0052] The description of the invention is merely exemplary in nature 
and, thus, variations that do not depart from the gist of the invention are intended 
to be within the scope of the invention. Such variations are not to be regarded as 
a departure from the spirit and scope of the invention. 
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